Papers by Amir H. Abdi
Llama See, Llama Do: A Mechanistic Perspective on Contextual Entrainment and Distraction in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | *contextual entrainment* occurs across a wide range of language models (LMs) and prompt settings. |
| Approach: | They hypothesize that there is a circuit of attention heads that corresponds to the phenomenon *contextual entrainment* . when they "turn off" these heads, the effect of contextual entraining is significantly attenuated. |
| Outcome: | The proposed method shows that LMs assign higher logits to tokens that have previously appeared in the context prompt, even for random tokens. |